Quality Control for Scientific Research: Addressing Reproducibility, Responsiveness, and Relevance

Continuous quality control for research data to ensure reproducibility : an institutional approach

Using prediction markets to estimate the reproducibility of scientific research.

Concerns about a lack of reproducibility of statistically significant results have recently been raised in many fields, and it has been argued that this lack comes at substantial economic costs. We here report the results from prediction markets set up to quantify the reproducibility of 44 studies published in prominent psychology journals and replicated in the Reproducibility Project: Psycholo...

Effect of Initial Conditions on Reproducibility of Scientific Research

BACKGROUND It is estimated that about half of currently published research cannot be reproduced. Many reasons have been offered as explanations for failure to reproduce scientific research findings- from fraud to the issues related to design, conduct, analysis, or publishing scientific research. We also postulate a sensitive dependency on initial conditions by which small changes can result in ...

Quantifying the Impact and Relevance of Scientific Research

Qualitative and quantitative methods are being developed to measure the impacts of research on society, but they suffer from serious drawbacks associated with linking a piece of research to its subsequent impacts. We have developed a method to derive impact scores for individual research publications according to their contribution to answering questions of quantified importance to end users of...

Reproducibility and Responsiveness of Evaluative Outcome Measures

Objective: This article outlines basic methods for quantifying reproducibility and responsiveness of evaluative outcome measures. Methods: The background noise in stable patients provides the desired information to quantify the reproducibility. From this, the smallest real difference (SRD) for longitudinal differences can be derived. We propose to use the SRD to define responsiveness: from all ...